Skip to content

Conversation

@jtrejoespinoza-grid
Copy link
Contributor

Summary

This test case automates the Test Case SU 2.5.
Verify the DUT behaves according the spec when is applying the software update.
In this test case Im using event handlers to verify the updates are happening in the expected timeframes, for this case Im validating updates are not happening and start in the limits of the expected values.

Related issues

Fixes: project-chip/matter-test-scripts#656

Testing

Launch the requestor:

./out/debug/chip-ota-requestor-app --discriminator 123 --passcode 2123 --secured-device-port 5540 --KVS /tmp/chip_kvs_requestor --autoApplyImage

Launch the test case

python3 src/python_testing/TC_SU_2_5.py --commissioning-method on-network --passcode 2123 --discriminator 123 --endpoint 0 --nodeId 123

@github-actions github-actions bot added the tests label Sep 29, 2025
…tionCluster.Softwareversion to update it and verify it did not happend in less than the delaytime
@github-actions
Copy link

github-actions bot commented Oct 2, 2025

PR #41182: Size comparison from 7756885 to 6e457eb

Full report (5 builds for cc32xx, realtek, stm32)
platform target config section 7756885 6e457eb change % change
cc32xx air-purifier CC3235SF_LAUNCHXL FLASH 552986 552986 0 0.0
RAM 204928 204928 0 0.0
lock CC3235SF_LAUNCHXL FLASH 585630 585630 0 0.0
RAM 205160 205160 0 0.0
realtek light-switch-app rtl8777g FLASH 704072 704072 0 0.0
RAM 106720 106720 0 0.0
lighting-app rtl8777g FLASH 755248 755248 0 0.0
RAM 127084 127084 0 0.0
stm32 light STM32WB5MM-DK FLASH 467692 467692 0 0.0
RAM 141160 141160 0 0.0

@github-actions
Copy link

PR #41182: Size comparison from bcb7758 to 1d9ff88

Full report (1 build for stm32)
platform target config section bcb7758 1d9ff88 change % change
stm32 light STM32WB5MM-DK FLASH 469028 469068 40 0.0
RAM 141200 141208 8 0.0

@github-actions
Copy link

PR #41182: Size comparison from c15b122 to 0ca5c31

Full report (1 build for stm32)
platform target config section c15b122 0ca5c31 change % change
stm32 light STM32WB5MM-DK FLASH 469812 469812 0 0.0
RAM 141248 141248 0 0.0

@jtrejoespinoza-grid jtrejoespinoza-grid marked this pull request as ready for review October 24, 2025 19:42
@github-actions
Copy link

github-actions bot commented Oct 24, 2025

PR #41182: Size comparison from b9971ce to 323f26d

Full report (37 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, efr32, esp32, nrfconnect, nxp, psoc6, qpg, realtek, stm32, telink)
platform target config section b9971ce 323f26d change % change
bl602 lighting-app bl602+mfd+littlefs+rpc FLASH 1106622 1106622 0 0.0
RAM 178874 178874 0 0.0
bl702 lighting-app bl702+eth FLASH 661198 661198 0 0.0
RAM 134969 134969 0 0.0
bl702+wifi FLASH 837310 837310 0 0.0
RAM 124405 124405 0 0.0
bl706+mfd+rpc+littlefs FLASH 1070278 1070278 0 0.0
RAM 117261 117261 0 0.0
bl702l contact-sensor-app bl702l+mfd+littlefs FLASH 899730 899730 0 0.0
RAM 105524 105524 0 0.0
lighting-app bl702l+mfd+littlefs FLASH 983040 983040 0 0.0
RAM 109740 109740 0 0.0
cc13x4_26x4 lighting-app LP_EM_CC1354P10_6 FLASH 770652 770652 0 0.0
RAM 103304 103304 0 0.0
lock-ftd LP_EM_CC1354P10_6 FLASH 782384 782384 0 0.0
RAM 108472 108472 0 0.0
pump-app LP_EM_CC1354P10_6 FLASH 728212 728212 0 0.0
RAM 97364 97364 0 0.0
pump-controller-app LP_EM_CC1354P10_6 FLASH 712672 712672 0 0.0
RAM 97580 97580 0 0.0
cc32xx air-purifier CC3235SF_LAUNCHXL FLASH 554226 554226 0 0.0
RAM 205736 205736 0 0.0
lock CC3235SF_LAUNCHXL FLASH 587474 587474 0 0.0
RAM 205832 205832 0 0.0
efr32 lock-app BRD4187C FLASH 963160 963160 0 0.0
RAM 123512 123512 0 0.0
BRD4338a FLASH 756744 756744 0 0.0
RAM 254136 254136 0 0.0
window-app BRD4187C FLASH 1058492 1058484 -8 -0.0
RAM 119740 119740 0 0.0
esp32 all-clusters-app c3devkit DRAM 102516 102516 0 0.0
FLASH 1827430 1827430 0 0.0
IRAM 93540 93540 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 933076 933076 0 0.0
RAM 161313 161313 0 0.0
nxp contact mcxw71+release FLASH 691904 691904 0 0.0
RAM 61496 61496 0 0.0
lighting mcxw71+release FLASH 723408 723408 0 0.0
RAM 68140 68140 0 0.0
lock mcxw71+release FLASH 773672 773672 0 0.0
RAM 61932 61932 0 0.0
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1676564 1676564 0 0.0
RAM 213900 213900 0 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1593180 1593180 0 0.0
RAM 211108 211108 0 0.0
light cy8ckit_062s2_43012 FLASH 1459724 1459724 0 0.0
RAM 197728 197728 0 0.0
lock cy8ckit_062s2_43012 FLASH 1492276 1492276 0 0.0
RAM 225440 225440 0 0.0
qpg lighting-app qpg6200+debug FLASH 837104 837104 0 0.0
RAM 127708 127708 0 0.0
lock-app qpg6200+debug FLASH 773884 773884 0 0.0
RAM 118684 118684 0 0.0
realtek light-switch-app rtl8777g FLASH 706624 706624 0 0.0
RAM 106904 106904 0 0.0
lighting-app rtl8777g FLASH 757712 757712 0 0.0
RAM 127236 127236 0 0.0
stm32 light STM32WB5MM-DK FLASH 470092 470092 0 0.0
RAM 141304 141304 0 0.0
telink bridge-app tl7218x FLASH 710570 710570 0 0.0
RAM 90544 90544 0 0.0
light-app-ota-compress-lzma-shell-factory-data tl3218x FLASH 796924 796924 0 0.0
RAM 41000 41000 0 0.0
light-app-ota-shell-factory-data tl7218x FLASH 788124 788124 0 0.0
RAM 93644 93644 0 0.0
light-switch-app-ota-compress-lzma-factory-data tl7218x_retention FLASH 715002 715002 0 0.0
RAM 51844 51844 0 0.0
light-switch-app-ota-compress-lzma-shell-factory-data tlsr9528a FLASH 748298 748298 0 0.0
RAM 70892 70892 0 0.0
light-switch-app-ota-factory-data tl3218x_retention FLASH 725154 725154 0 0.0
RAM 34592 34592 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 602398 602398 0 0.0
RAM 108904 108904 0 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 820728 820732 4 0.0
RAM 92040 92040 0 0.0

@github-actions
Copy link

github-actions bot commented Nov 5, 2025

PR #41182: Size comparison from 2c0b7fc to 4525982

Full report (35 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, efr32, esp32, nrfconnect, nxp, psoc6, qpg, realtek, stm32, telink)
platform target config section 2c0b7fc 4525982 change % change
bl602 lighting-app bl602+mfd+littlefs+rpc FLASH 1106262 1106262 0 0.0
RAM 178914 178914 0 0.0
bl702 lighting-app bl702+eth FLASH 661392 661392 0 0.0
RAM 135017 135017 0 0.0
bl702+wifi FLASH 836934 836934 0 0.0
RAM 124437 124437 0 0.0
bl706+mfd+rpc+littlefs FLASH 1070472 1070472 0 0.0
RAM 117293 117293 0 0.0
bl702l contact-sensor-app bl702l+mfd+littlefs FLASH 899904 899904 0 0.0
RAM 105572 105572 0 0.0
lighting-app bl702l+mfd+littlefs FLASH 983218 983218 0 0.0
RAM 109772 109772 0 0.0
cc13x4_26x4 lighting-app LP_EM_CC1354P10_6 FLASH 770616 770616 0 0.0
RAM 103344 103344 0 0.0
lock-ftd LP_EM_CC1354P10_6 FLASH 782452 782452 0 0.0
RAM 108512 108512 0 0.0
pump-app LP_EM_CC1354P10_6 FLASH 728384 728384 0 0.0
RAM 97404 97404 0 0.0
pump-controller-app LP_EM_CC1354P10_6 FLASH 712860 712860 0 0.0
RAM 97620 97620 0 0.0
cc32xx air-purifier CC3235SF_LAUNCHXL FLASH 554894 554894 0 0.0
RAM 205776 205776 0 0.0
lock CC3235SF_LAUNCHXL FLASH 587774 587774 0 0.0
RAM 205872 205872 0 0.0
efr32 lock-app BRD4187C FLASH 963296 963296 0 0.0
RAM 123544 123544 0 0.0
BRD4338a FLASH 757480 757480 0 0.0
RAM 254184 254184 0 0.0
window-app BRD4187C FLASH 1058532 1058532 0 0.0
RAM 119772 119772 0 0.0
esp32 all-clusters-app c3devkit DRAM 102556 102556 0 0.0
FLASH 1836588 1836588 0 0.0
IRAM 93540 93540 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 933240 933240 0 0.0
RAM 161361 161361 0 0.0
nxp contact mcxw71+release FLASH 692208 692208 0 0.0
RAM 61536 61536 0 0.0
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1677828 1677828 0 0.0
RAM 213940 213940 0 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1594220 1594220 0 0.0
RAM 211148 211148 0 0.0
light cy8ckit_062s2_43012 FLASH 1460460 1460460 0 0.0
RAM 197768 197768 0 0.0
lock cy8ckit_062s2_43012 FLASH 1493140 1493140 0 0.0
RAM 225480 225480 0 0.0
qpg lighting-app qpg6200+debug FLASH 837544 837544 0 0.0
RAM 127748 127748 0 0.0
lock-app qpg6200+debug FLASH 774356 774356 0 0.0
RAM 118724 118724 0 0.0
realtek light-switch-app rtl8777g FLASH 706728 706728 0 0.0
RAM 106952 106952 0 0.0
lighting-app rtl8777g FLASH 757672 757672 0 0.0
RAM 127284 127284 0 0.0
stm32 light STM32WB5MM-DK FLASH 470056 470056 0 0.0
RAM 141344 141344 0 0.0
telink bridge-app tl7218x FLASH 710586 710586 0 0.0
RAM 90584 90584 0 0.0
light-app-ota-compress-lzma-shell-factory-data tl3218x FLASH 797060 797060 0 0.0
RAM 41008 41008 0 0.0
light-app-ota-shell-factory-data tl7218x FLASH 788262 788262 0 0.0
RAM 93684 93684 0 0.0
light-switch-app-ota-compress-lzma-factory-data tl7218x_retention FLASH 715264 715264 0 0.0
RAM 51876 51876 0 0.0
light-switch-app-ota-compress-lzma-shell-factory-data tlsr9528a FLASH 748560 748560 0 0.0
RAM 70916 70916 0 0.0
light-switch-app-ota-factory-data tl3218x_retention FLASH 725414 725414 0 0.0
RAM 34608 34608 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 602692 602692 0 0.0
RAM 108912 108912 0 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 820896 820900 4 0.0
RAM 92080 92080 0 0.0

…launched with --secure-device-port. Removed break in monitor_app_requestor to allow multiple restarts
@github-actions
Copy link

github-actions bot commented Nov 6, 2025

PR #41182: Size comparison from 2c0b7fc to 9359df4

Full report (35 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, efr32, esp32, nrfconnect, nxp, psoc6, qpg, realtek, stm32, telink)
platform target config section 2c0b7fc 9359df4 change % change
bl602 lighting-app bl602+mfd+littlefs+rpc FLASH 1106262 1106340 78 0.0
RAM 178914 178930 16 0.0
bl702 lighting-app bl702+eth FLASH 661392 661414 22 0.0
RAM 135017 135025 8 0.0
bl702+wifi FLASH 836934 837008 74 0.0
RAM 124437 124445 8 0.0
bl706+mfd+rpc+littlefs FLASH 1070472 1070610 138 0.0
RAM 117293 117317 24 0.0
bl702l contact-sensor-app bl702l+mfd+littlefs FLASH 899904 900042 138 0.0
RAM 105572 105612 40 0.0
lighting-app bl702l+mfd+littlefs FLASH 983218 983356 138 0.0
RAM 109772 109796 24 0.0
cc13x4_26x4 lighting-app LP_EM_CC1354P10_6 FLASH 770616 770820 204 0.0
RAM 103344 103360 16 0.0
lock-ftd LP_EM_CC1354P10_6 FLASH 782452 782664 212 0.0
RAM 108512 108528 16 0.0
pump-app LP_EM_CC1354P10_6 FLASH 728384 728612 228 0.0
RAM 97404 97420 16 0.0
pump-controller-app LP_EM_CC1354P10_6 FLASH 712860 713080 220 0.0
RAM 97620 97636 16 0.0
cc32xx air-purifier CC3235SF_LAUNCHXL FLASH 554894 554906 12 0.0
RAM 205776 205776 0 0.0
lock CC3235SF_LAUNCHXL FLASH 587774 587786 12 0.0
RAM 205872 205872 0 0.0
efr32 lock-app BRD4187C FLASH 963296 963504 208 0.0
RAM 123544 123572 28 0.0
BRD4338a FLASH 757480 757752 272 0.0
RAM 254184 254196 12 0.0
window-app BRD4187C FLASH 1058532 1058820 288 0.0
RAM 119772 119800 28 0.0
esp32 all-clusters-app c3devkit DRAM 102556 102572 16 0.0
FLASH 1836588 1836720 132 0.0
IRAM 93540 93540 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 933240 933452 212 0.0
RAM 161361 161377 16 0.0
nxp contact mcxw71+release FLASH 692208 692504 296 0.0
RAM 61536 61552 16 0.0
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1677828 1678092 264 0.0
RAM 213940 213956 16 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1594220 1594492 272 0.0
RAM 211148 211156 8 0.0
light cy8ckit_062s2_43012 FLASH 1460460 1460732 272 0.0
RAM 197768 197776 8 0.0
lock cy8ckit_062s2_43012 FLASH 1493140 1493420 280 0.0
RAM 225480 225496 16 0.0
qpg lighting-app qpg6200+debug FLASH 837544 837768 224 0.0
RAM 127748 127768 20 0.0
lock-app qpg6200+debug FLASH 774356 774580 224 0.0
RAM 118724 118736 12 0.0
realtek light-switch-app rtl8777g FLASH 706728 706952 224 0.0
RAM 106952 106964 12 0.0
lighting-app rtl8777g FLASH 757672 757896 224 0.0
RAM 127284 127296 12 0.0
stm32 light STM32WB5MM-DK FLASH 470056 470224 168 0.0
RAM 141344 141352 8 0.0
telink bridge-app tl7218x FLASH 710586 710608 22 0.0
RAM 90584 90600 16 0.0
light-app-ota-compress-lzma-shell-factory-data tl3218x FLASH 797060 797084 24 0.0
RAM 41008 41024 16 0.0
light-app-ota-shell-factory-data tl7218x FLASH 788262 788286 24 0.0
RAM 93684 93700 16 0.0
light-switch-app-ota-compress-lzma-factory-data tl7218x_retention FLASH 715264 715286 22 0.0
RAM 51876 51892 16 0.0
light-switch-app-ota-compress-lzma-shell-factory-data tlsr9528a FLASH 748560 748582 22 0.0
RAM 70916 70932 16 0.0
light-switch-app-ota-factory-data tl3218x_retention FLASH 725414 725436 22 0.0
RAM 34608 34624 16 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 602692 602672 -20 -0.0
RAM 108912 108928 16 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 820896 820922 26 0.0
RAM 92080 92096 16 0.0

@jtrejoespinoza-grid
Copy link
Contributor Author

Some changes were made into run_python_test in the method monitor_app_restart_requests. The break from the while loop was removed because this only allowed one restart. Also the apps is stopped first to avoid por collisions in case the argument --secure-device-port is used to launch the app.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

TC-SU-2.5: Automate and consolidate with other tests

1 participant